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AESSEiCT 

This report describes the procedures and results of a 
field test of an instructional unit intended for upper elementary and 
secondary teachers who have some access to computers. The unit 
consists of five booklets covering the rudiments of computer 
hardware, computer programing languages, the different roles the 
computer aay play in instruction, how the computer is used in 
different curriculum areas, and how to select an instructional 
computer application that is appropriate to one^s needs. The field 
test population consisted of teachers both inexperienced and 
experienced in coanputer use. Evaluation focused upon the attainment 
of educational objectives, the potential of competitive educational 
methods, and on important side effects from the use of the materials. 
The data indicated that the objectives were obtained and, 
unexpectedly, even the experienced group benefited. Competitive 
instruction through a seminar was judged not significantly different 
from booklet use, though booklets are thought to be independently 
usable. Side effects (unexpected outcomes) were numerous: notably, 
increased interest in computer use, in the demand for computer 
access, in the need to develop a communication network about 
computers and in an awareness of computer information resources. The 
objectives of each booklet and the questionnaires used are presented 
in appendices. (DAG) 
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INTBODUCTION 



The purpose of this technical report to the National Institute of 
Education Is to describe the Interim version of the Instructional unit 
"Selecting and Specifying Computer Enhanced Units," and to describe the 
procedures and results of the field test of that unit. "Selecting and 
Specifying" Is one of a series of Instructional units being developed by 
the Computer Technology Program at the Northwest Regional Educational 
Laboratory, under contract with the National Institute of Education. It 
Is hoped that the Information furnished herein will be valuable to NIE In 
Its task of monitoring the development and evaluation of this project. 



MATERIALS 

Intended Use 

These materials are Intended primarily. for th^ Instruction of upper 
elementary and secondary school teachers who have some access to 
computers. Since Computer Enhanced Instruction (CEI) materials p.re 
highly subject oriented, this Instruction is primarily for those teachers 
who are deeply Involved In one or two subject areas. However, secondary 
audiences for these materials may be experts In CEI applications and college 
or In-service Instructors interested in teaching about CEI. 

The booklets developed in this project may be used In several different 
ways. The original intent of the developers was that all five booklets were 
to form the basis for a four-day workshop on selecting computer-enhanced 
units, with How to Select Units to serve as the primary text, and the 
Background Booklets to serve as a supplement for those participants who 
might lack some necessary knowledge of computers in instruction. Since 
it was expected that these workshops would contain participant's with varying 
experience in computers, the Background Booklets were designed to bring 
all participants to a common level of knowledge. However, alternate formats 
have been proposed and employed. In one case, the Background Booklets 
only were used as the basis of a four-day workshop for teachers naive about 
computers, and in another case. How to Select Units was used as the basis 
for a four-day workshop for teachers experienced in computers. Thus, 
developers believe that these materials can be used flexibly in a number of 
settings where the concern is instructional applications of the computer. 



'^Selecting and Specifying Computer Enhanced Units'' Is an Instructional 
system consisting of five booklets. Four of the booklets are called 
''Background Booklets," and they are Intended to acquaint the user with the 
rudiments of computer hardware, computer programming languages, the 
different roles the computer may play in Instruction, and how the computer 
Is used In several different curriculum areas. The fifth booklet, titled 
How to Select Units. Is Intended to teach the user how to select an 
Instructional computer application that Is appropriate to his needs. A 
description of each booklet. Including objectives as stated In the booklet, 
appears below. ^ 

Hardware at a Glance 
This Is a 22-page booklet In five sections designed to Introduce the 
user to the fundamental aspects of computer hardware. The booklet first 
describes the three basic types of hardware — Input/output units, the central 
processing unit, and storage devices — and then very briefly Introduces 
software and Its uses. Next, It describes the Interactive and batch modes 
of communicating with the computer and discusses their advantages and 
disadvantages. In the third section, the different types of Input/output units 
are described with particular emphasis on Interactive termlnalisy The 
fourth section explains briefly how and where a computer program Is stored 
and the last section deals with size of computer systems. At the end of 
the unit, a Comprehension Check allows a check^of the student's understanding 
of the key concepts In the unit. 

^For ease of future reference, objectives of all five booklets are 2 
collected In Appendix A. 



Listed below are the Instructional objectives for this unit which 
Identify what a person who completes the booklet should be able to do: 

1. List the three essential pieces of hardware for a 
computer system. 

2. Distinguish between Interactive and batch modes of 
processing. 

3. State the advantages and disadvantages of Interactive 
processing. 

4. Recognize sonxp commonly used Input/output devices. 

5. Define what Is meant by "time-sharing." 

6. Describe how a program Is activated for use In terms 

of the computer's working memory and computer storage. 

?• Explain what happens to a program when the user signs 
off the terminal. 

». 

8. Know where to obtain advice as to whether or not your 
computer is large enough to run a given program. 

Software at a Glance 

This unit is a 47-page booklet in four sections designed to introduce 

the user to important topics in computer software. The first section deals 

with the mechanics of selecting and running a computer program on a 

teletype. The second section explains the purpose of a programming 

language and introduces five such languages. The third section describes 

the components of a computer program, including input instructions, 

processing instructions, output instructions, END, and remarks. A simple 

program is used as an example to show how a computer would execute each 

program component. The fourth section lists and describes the keys to 
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recognizing four languages- -FOR TTl AN. BASIC> ALGOL, and PL/l. At 
the end of this unit, there Is also a Comprehension Check, 

Listed below are the instructional objectives for this unit which 
identify what a person who completes the booklet should be able to do; 

1. List at least three available sources of user*s programs 

2. Identify three common ways of loading a program for use 

3. Describe two common ways a program can be *^stored*' 
for use in the classroom ir. 

4. Identify the differences between machine language and 
programming languages 

5. Describe the function of translators in the computer's 
software system 

6. Explain the main reason why there are many different 
programming languages 

7. State the three fundamental elements involved in any 
computer program 

8. Given a simple program in any of the languages commonly 
used in instructional programs 

0 Identify the input instructions 

0 Identify the processing instructions 

0 Identify the output instructions 

0 Identify the' control instructions 

0 Identify the programmer's remarks 

0 Determine the general purpose of the program 

9. Follow a simple BASIC program dealing with a subject in 
one's discipline and understand the main steps the computer 
goes through in processing input and producing output. 

The Roles of the Computer in Instruction 

This is a 50-page booklet designed to acquaint the user with several 

of the roles that the computer can play in instruction. The first section 
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describes how the role of the computer can vary and introduces the five 
most important roles of the computer in instruction. The sepond section 
discusses the use of the computer as a drill and practice device. The 
third section explains using the computer as a tutor. The fourth section 
explains the role of the computer in problem-solving in the classroom. 
The sixth section details the role of the computer in simulations and games. 
This unit concludes with a cautionary note about the overlap of the various 
roles and briefly describes some additional roles of the computer in 
instruction. As before, a Comprehension Check is included at the end to 
assist the user in verifying his understanding of the key concepts. 

The following instructional objectives for this unit describe what a 
person who completes the booklet should be able to do: 

1. Name the five major roles of the computer in instruction. 

2. State the distinguishing characteristics of programs which 
use the computer in each of the five major roles. 

3. Given a sample interaction with a program, determine 
which computer role is used. 

4. Explain how computer roles may overlap in a single 
instructional program. 

5. Determine which computer roles would be appropriate 
for specific instructional situations. 

6. Identify the functions of computer-managed instruction 
(C^n). 

7. Identify the main characteristics of the inquiry mode 
of computer use. 
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Computers in the Curriculiimt A Book of Headings 
This is a 149-pnge booklet designed to acquaint the user with actual 
and potential applications of the computer in a variety of curricula. 
Consisting of a series of readings written by experts in computer applicatlonst 
the booklet describes ways the computer might be used in courses of art 
education, business education, education of the handicapped, elementary 
education, language arts, mathematics, music, physical education, secondary 
science, natural science, the social sciences, social studies, and vocational 

i 

\ agriculture. No instructional objectives have been specified for this unit 

because the book was intended only to convey general information. 

How to Select Units 
This unit is a 60-page booklet designed to teach the user how to 
select instructional computer applications which are appropriate to his or 
her needs. The unit has been organized into three major parts. The first 
part of the unit describes the five roles of the computer in instruction and 
explains the two main components of a computer-enhanced instructional 
experience: the computer system and instructional unit. This part of the 
unit concludes by introducing a two stage process for evaluation of computer- 
enhanced instruction units. The second part details the first stage of the 
evaluation process, which focused on whether the unit one is interested in 
is usable on an available computer. Five critical questions to ask about 
characteristics of the computer system and the instructional units are list^^ J. 
The process of making an initial decision based on the answers to these 

questions, is also disct'ssed. The third part details the final stage of the 
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decision procass, which Is concornod with final decisions. It lists anJ 
explains such considerations as eahancoment of lnstructlon» ^^student- 
proofnoss,** user-orlentotlon> ccntroUable variables, options for use, 
and time and cost factors. This section concludes with a discussion of 
the final decision, and the specification of a procedure for assigning weights 
to the various factors for purposes of decision-making. The unit also 
Includes an appendix which lists a number of sources of computer-enhanced 
Instruction units. Sample printouts are used liberally, in order to acquaint 
the user with available programs. Exercises are also Included at various 
points In order to give the user practice In the key concepts. 

The following Instructional objectives describe what a person who 
completes the unit should be able to do, given a computer-based Instructional 
package: 

1. List five critical aspects of a computer-enhanced unit 
which should be examined at the Initial stage In 
selecting units for classroom use. 

2. For each of the Initial critical aspects of a unit, 
explain why it is critical In the selection process. 

3. List at least five final aspects of a unit which should be 
considered in making final decisions on units. 

4. Describe or explain what the terms '*student-proof" and 
''user-oriented'» mean, ir terms of computer programs. 

5. Discuss how the number of variables and the number 
of options in a computer program relate to the 
program's utility in the classroom. 

6. Identify three time/cost factors involved in using 
computer-enhanced units in classroom instruction. 



Given computer-enhanced curriculum units in 
their field of teaching— 

o Determine if the hardware and software 

requirements make the units feasible for use. 

o Determine if the objectives, materials, and 
models are suitable for his/her use. 

o Rate the units on at least five final variables. 

I 

^o ^^elect_the unit(s) will best suit their needs 



DEVELOPMENTAL fflSTORY 
? ■ Developmental Plan * 

The plan for development of the "Selecting and Specifying Computer 
Enhanced Units'' was guided by the Northwest Regional Educational 
Laboratory's model for product development. This model,, broadly conceived, 
calls for initial conceptual work, followed by the development of an exploratory 
:; version of the product. The exploratory version is tested, and formative 

evaluation data are gathered that are utilized in building the next developmental 
version, called the prototype version. A pilot test of the prototype 3nLelds 
further formative data which guide the development of an interim version 
of the product. Finally, summative data about the product are gathered in 
a field test. 
Initial Development 

The initial development of the materials In the "Selecting and 
Specifying Computer Enhanced Units" course was guided by a preliminary 
assessment of contents and selection criteria made in January and 
February 1973, by several experts in the use and development of computer- 
oriented instructional materials: Don Holznagel of Southern Minnesota 
School Computer Project; Glenn Ingram, then Director of the Washington 
State University Computer Center; Elizabeth Williamson of the Huntington 
Two Project, SUNY and Judith B. Edwards, principal developer for the 
materials. These assessments were reviewed by Glenn Ingram and some 
final suggestions were made. 
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Based on this initial content determination, the principal developer 
began in April 1973, to draw up the outline of products and processes for 
this course. At the same time, a complete set of goals for each component 
was developed. The initial list of components included: 

Computer Hardware for Instruction 

Computer Software for Instruction 

Instructional Modes 

The Computer in Instruction 
J Writing Behavioral Objectives 

What is a Model? 

Filmstrips illustrating instructional uses of computers; How 
to Select Computer Instruction Materials . 
How to Write Specifications for Computer 
Instruction Materials. 

A two-day consultation session was held in May. 1973 involving 
Don Holznagel, Judith Edwards and Dan Klassen to define specific contents 
,,and criteria for each component in the materials. Choosing from a vast 
number of available programs and units, consultants also created a resource 
pool of samples illustrating key concepts, program features, and types of 
materials to be treated in the course. 

Following the. guidelines established! in consultation sessions, 

development of the materials began in June 1973. Through the Initial 

development phase, editorial and developer di3cisions introduced the following 

changes in the course components: 

1, Writing Behavioral Objectives was to be excluded, as 

several excellent tests on the skill were currently available 
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2. What is a Model? was to be excluded from the Background 
Booldets and the topic treated briefly in the ^'Selecting'* 
text 

3. The filmstrip would be unnecessary, since ample illustration 
of computer uses would be given by the ^'Computers in the 
Curriculum^' booklet, together with user participation in 
sample unit experiences during the course 

4. Two sets of sample units should be provided (a set of 15 

to 20 exemplary units for use with the course and a starter 
set of 40 units) along with a diagnostic test which could tell 
course participants which. Background Booklets they needed 
to study at the outset. 

7. :oloratory Test 

In September 1973, exploratory versions of all components, except 
the Leader's Guide and the specially designed introductory sample unit were 
ready for testing. Blue Mountain Community College in Pendleton, ^ ?egon, 
was selected as the test site, with 20 teachers testing the course materials 
in a workshop setting. 

Biographical data on the teachers indicated that the group was 
comparable to the general target population. Specifically, they represented 
a wide range of educational backgrounds and teaching experience, as well 
as generally having had little or no previous experience with computers in 
instruction. The available exploratory versions of materials were used 
with this initial test group, beginning in early October 1973 with an 
introductory sample unit called BALPAY (a previously developed unit) being 
substituted for the introductory sample unit that was not yet available. 
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Test data were collected in three ways: 

1. An eight item questionnaire about contents and readability 
was completed by each participant after reading each 
component in the course. 

2. Participants were asked to make notes about problems 
and suggestions in their copies of each^book and to hand 
in these annotated books at the end of the workshop. 

3. Verbal data were obtained by taping two round-table 
discussions about the components and the course as a 
whole. 

On the basis of this initial testing, considerable data were collected 
which were used in planning revisions of the components. Since not all 
of the course materials were available for this test, however, it was 
decided that another test should be made before revising the components, 
with the exception of the How to Select Units test. In consultation with 
Judith Edwards, Dan Klassen, the new developer, made complete revisions 
of the text in January 1974 and a revised exploratory version was available 
in February 1974. In addition, the special introductory sample unit. 
Urban Crime Unit, and the Leader's Guide were available in exploratory 
versions at this time. 

A second test was conducted in February 1974 at Sunset High School 
in Beaverton, Oregon, with a group of teachers comparable to the group 
at Blue Mountain Community College. The data collected from this test 
were largely anecdotal, with the developer, Dan Klassen, on site to observe. 
Additional data were collected on the text How to Select Units . Further, 
data substantiated the advisability of excluding the diagnostic test and the 
two sets of sample units as unsuitable. In addition, it was suggested that 



the text, How to Write Specifications for New Units, be excluded until a 

later time^ when guides for ^^Developing Units'^ would be written and could . 

serve as a focus for the writing of specifications. 

Prototype versions cf the course components were available in 

June 1974 for pilot testing, including: 

Leader^s Guide 
Urban Crime Unit 
How to Select Units 
Hardware at a Glance 
Software at a Glance 

The Roles of the Computer in Instruction 
Computers in the Curriculum; A Book of Readings 

The Leader^s Guide and the Urban Crime Unit were designed to 

assist instructors in using the Background Booklets and How to Select 

Units at test sites. There was no plan to evaluate the effectiveness of 

the Guide and the Urban Crime Unit. 

Pilot Test 

In the pilot test, the materials were tested in two sections. The 
four Background Booklets were tested in one set of workshop sessicis, 
and How to Select Units was evaluated in another set. 

Pilot testing on the Background Booklets was carried out in five 
summer workshops, sponsored by the Minnesota Educational Computing 
Consortium (MECC), involving five groups of elementary and secondary 
teachers in a variety of subject areas. 



2The pilot test report dated July 1974, fully discusses the plan, 
procedures and results of pilot testing efforts. 



18 



13 



Each of the five groups was given a pre-test covering attitudinal 
and cognitive objectives related to the Background Booklets. Two of the- 
groups then spent four days reading and discussing the Background Booklets, 
learning how to use the computer and using Computer-Enhanced Instruction 
(CEI) programs. One of these two groups was led by a developer of the 
materials, while the other was led by a MECC group leader. The remaining 
three groups underwent a regular MECC workshop. 

All groups then were given post-tests of attitude and knowledge. 
Results of the testing showed that the developer-led group scored highest 
in the area of knowledge. This may reflect the developer's greater 
acquaintance with the materials. Further, results indicated that under 
some conditions, the Background Booklets can be more effective than a 
competitor. 

Testing of the How to Select Units booklet involved members of two 
other MECC sponsored workshops, and involved a sample of teachers 
experienced in the use of computers. Each of the two groups filled out a 
biographic questionnaire and took pre-tests of attitude and knowledge 
covering objectives of the How to Select Units booklet. Following instruction 
in the contents of the How to Select Units booklet, both groups took post- 
tests of knowledge and attitude. 

Results of testing showed that both groups made significant gains 
from pre-test to post-test, but that there was no significant difference 
between the gains of the two groups. 



Data collected about the materials during the pilot test were also 



useful developers In revising the product for the final stage of development. 

The following decisions regarding revision were made: 

!• The Background Booklets on computer hardware and 
The Roles of the Computer In the Curriculum were 
judged satisfactory. 

2. Stated objectives In the Background Booklet, Software 
at a Glanc e were changed. Also, the section on 
discrimination of languages was made optional. 

3. For the Background Booklet, The Role of the Computer 
in Instruction, definitions of drill and practice and 
tutor as they apply to computer fun^jtlons were changed. 
The comprehension check was also revised to accommodate 
these changes. 

4. How to Select Units was judged satisfactory. 
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SUMMATIVE EVALUATION , 
Purpose of Summative Evaluation 

The purpose of the summative evaluation is to provide data about 
the performance of the product. 

The summative evaluation of ''Selecting and Specifying Computer 
Enhanced Units*' had three foci. First, the evaluation focused upon the 
attainment of instructional objectives. Here, the evaluation was concerned 
with whether or not the use of the materials led to achievement of instructional 
goals. 

The second focus was on "critical competitors.'' The Evaluation 
sought to determine whether the materials perform better than their potential 
competitors in the educattoriii market. 

Finally, the third focus of the summative evaluation was upon the 
identification of any important side effects, either positive or negative, of 
use of the materials. 

The field test was undertaken during the month of October 1974 in 
Minnesota. 

Background of Populations Tested 

The population tested consisted of a treatment group of teachers 
inexperienced in the use of computers and a comparison group of teachers 
who had had experience with computers. 

Group 1 (experienced) consisted of 11 teachers enrolled in a workshop of the 
MIXC who were receiving training in the "Selecting and Specifying Computer 

Enhanced Units" system as part of their workshop training. 

16 
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Enhanced Units" system as part of their workshop training. 

Group 2 (inexperienced) consisted of 12 students enrolled in a compute 
course entitled ''Computers in the Classroom'' at Mankato State University 
in Mankato, Minnesota. This class consisted of current and prospective 
teachers, and they received the workshop covering the How to Select Units 
booklet as a part of the coursework for the clasps. 

Both groups contained teachers of grades 7 through 12. The average 
teaching experience in Group 1 was 15.5 years (range 7 through 14), while 
for Group 2, average teaching experience was 5 years (range 4 through 7). 
Eight of the participants in Group 2 reported no teaching experience. 
Group 1 participants had substantially more experience as teachers than did 
participants in Group 2. 

Nine of the participants In Group 1 had at least some experience with 
computers; however, only five (out of eleven) reported themselves as being 
"experienced" (that is, knowing a programming language and being capable 
of writing classroom applications) with computers! All 12 of the participants 
In Group 2 classified themselves either as having "moderate experience" or 
as being "experienced." Nine of the twelve participants In Group 2 classified 
themselves In the latter category, so that It can be said that participants 
In Group 2 were substantially more experienced In the use of the computer 
than participants In Group 1. 
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The treatment group (Group 1), received both the Background Booklets 
and the How to Select Units, The control group (Group 2), received the 
How to Select Units only, along with materials and a teacher's guide for a 
workshop, designed to help participants master the materials in the booklet. 
Cognitive Assessment 

Major revisions in the instrumentation for this field test were under-- 
taken since instructional objectives of the materials had been substantially 
revised during exploratory testing. However, items found to be acceptable 
during pilot testing were retained if they were consistent with the new 
objectives, 

A set of 53 items was constructed and assembled to measure 
achievement of the instructional objectives for the Background Booklets.^ 
These 53 items were randomly divided into four subtests of varying 
lengths for purposes of multiple matrix sampling: ^ 

No of 

Subtests Items 

Form B-1 13 

Form B-2 13 

Form B-3 14 

Form B-4 13 

To measure achievement on the How to Select Units objectives, a 

set of 18 items was constructed and assembled. These items were randomly 

subdivided into three tests of six items each, and designated Forms S-1, 

S-2 and S-3. 



'^Objectives are listed in Appendix A. Additionally, a complete set 
of instruments used in the field test is collected in Appendix B. 

^Sirotnik, Kenneth A., ^^Introduction to Matrix Sampling for the Practitioner,^' 
in Evaluation in Education, W. James Popham, ed. , McCutchan Publishing 
Company, 1974, pp. 451-530. 
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Attitudinal Assessment 

An instrument measuring participants* attitude toward computers in 
the classroom was also devised. This instrument was administered before 
and after the workshop to both groups. On the post version, an additional 

r 

set of questions was supplied which attempted to elicit how participants 
felt about the workshop. The post version also asked participants for 
certain background data, as previously described. (See Appendix B for 
these questionnaires). 
Selection of Critical Competitor 

For the Background Booklets, a literature search revealed no single 
published competitors which shared a significant number of instructional 
goals with the background materials. The main shortcomings of the 
materials identified involved: 

a. Lack of classroom applications, other than CAI or CM 

b. Lack of specific subject area applications for use by 
the classroom teacher 

The second most likely source of competition was deemed to be 

college courses in educational applications of computers. A course. 

Computers in the Classroom, taught at Mankato State University which 

contained goals similar to those of the How to Select Units booklet, was 

selected. 

Another literature search revealed no published competitors that 
covered the same content as How to Select Units. However, three 
organizations were identified that conduct workshops for teachers using 



computers in the classroom. The workshops are generally intended for 
naive teachers, and one of these — the workshop conducted by MECC — was 
selected as the most serious competitor. This workshop consisted of an 
introduction to the use of the computer as a classroom tool, and the 
instructional goals were deemed highly similar to the goals of both the 
Background Booklets and the How to Select Units booklet. 
Side Effects 

The following procedure was used to determine if the possible 
immediate" side effects (8a, b and c) could be detected. Workshop 
leaders and randomly selected teachers were asked if they observed 
any of the possible immediate side-effects identified above, or any other 
side effects. They were also asked about their general impression of 
the workshop. "Responses were tape recorded. 
Test Procedures 

The treatment group received in the mail, (one week prior to the 

workshop) a packet containing: 

An introduction letter 

An attitude pre-questionnaire 

A pre-test of background materials (Form B-1, 
B-2, B-3 or B-4) and the four background booklets 

Students were directed to study the four Background Booklets in the week 

before the Workshop began. 



.At the beginning of the first Workshop session, participants were 
asked to record which form of the background pre-test they received (so 
that they would receive a different form for the background post-test) and 
the attitude and background pre-tests were both collected. Participants were 
then given a background post-test. 

When it was completed, participants received and completed the 
How to Select Units pre-test, again recording the form of It they took, so 
as to insure they would have a different form on the post-test. 

At the conclusion of the second workshop session, the "Selecting'' 
post-test and the attitude post-questionnaire were administered and collected. 

The comparison group followed essentially the same schedule, 
except that It received no background pre-test. 

The two schedules compared appear schematically as 
follows: 





Attitude 


Background 


Background 


Selecting 


Selecting 


Attitude 




Pre-test 


Pre-test 


Post-test 


Pre-test 


Post-test 


Post-test 


Treatment 


X 


X 


X 


X 


X 


X 


(Group 1) 














Comparison 


X 




X 


X 


X 


X 


(Group 2) 
















One week before 


Beginning of the 


End of 






the workshop 


the workshop 


the workshop 
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RESULTS 

As described in the previous section, a pre-test and post-test 
measurement of prevalent attitudes about the use of computers was 
administered to both groups. The instrument consisted of eight items. 
A summary of the pre- and post-test mean scores for each item along 
with t-tests of significance for pre- to post-test gains are presented in 
Table 1. 



TABLE 1 



Summary of Pre- lo Post-test Attitude Gains 
(Score Range l-Ti Low scores denote positive attitudes) 
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7. Frequency of 














piiinnea compuier 














use 




2.5 


,98 


1.4 


1.8 


1.09 


8. Ability to choose 














appropriate computer 














applications 


3.9 


2.6 


3.04*** 


2.9 


2.5 


1.00 



* Pre-test means adjusted for loss of respondents from pre-test to post-test 



** Eange 1-7 with low scores Indicating positive attitudes 
*** Significant at the .05 level or better 



. . . In the pre-test, the comparison group tended to express a more 
confident attitude toward computers than did the treatment group. This was 
expected since the comparison group was composed of persons experienced In 
the use of computers. This confidence Is reflected by the responses to all 
eight Items. The means for each of the Items for the comparison group are 
consistently lower than for the treatment group, Indicating a more confident 
attitude. 

From pre-test to post-test substantial gains were made by the 
treatment group, Group 1, on all Items except numbers 4 and 7. The 
lack of gains on these two Items Is most likely due to the fact that they 
tap the respondents' basic attitudes toward the use of computers In Instruction 
which IS unlikely to be changed during a brief workshop. The other Items 
are oriented more toward knowledge and applications of computer use. 
The comparison group, Group 2, does not show a gain from pre-test to 
post-tisst, but It still has somewhat more positive ratings than Group 1. 
The only significant pre/post gain for Group 2 is on Item 2 which has to 
do with knowledge of classroom computer use. This result Is not surprising 
since the workshop was intended to increase knowledge of classroom 
computer use. 

In order to test the difference between the two groups on the 
attitude post-tQst, an analysis of covarlance was carried out, using the 
attitude pre-test as the covarlate. The results of this analysis appear 
in Table 2. As these data show, there are no significant differences for 
seven of the eight items on the test. Hence, it can be concluded that the 
two groups tested do not differ in attitude toward computers in the classroom. 
Furthermore, it is notable that all attitudes expressed are positive. 24 
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TABLE 2 



Analysis of Covarlance for Attitude Tests (Groups 1 and 2) 



Item 


• 


SS 


df 


MS 


F 


1. 


lompuiGr usoiuinoss 


lUlal 


ft 7R 


90 














i J 


46 


07 






i iwClllilvlIl 




1 

X 


1 vu 




0 


Knowieage oi class- 


1 Jlai 




91 




■ 




room computer use 




1? 811 


20 




02 








0 


X 


01 


^ 


0 

0. 


loniicionce aoout 


lOiai 


in Qfi 

lUlOO 


91 








computer use 


iJll vi 




20 


37 


9 21* 

i/i ^x 








1 41 


1 

X 






4. 


. 

Willingness to use 


iotai 


4.4/ 


01 

Li 








computer 






90 


91 


1 04 






1 rcailllcni 


94 
tin 


1 
1 


9i 

. In _ ^ 






lompetcnce m use 


lotai 




01 








of computer 




11 40 


20 




1 14 

Xi X*Z 






X X vAlXilCUl 


65 


1 

X 


65 




b. 


iNuwDer 01 computer 




1Q 71 


91 
Li 








uses known 


JjXXUI 


1Q fil 
Xi/* ox 


90 




10 


u— 




Trpfll'tiipnl' 

X XCAlXilvUL 


10 

• IV/ 


1 
X 


10 




7. 


Frequency of 


Total 


,35.55 


21 








planned computer 


uX X uX 




20 


1 75 

X • J V 


29 




use 
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.51 


1 
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8. 


Ability to choose 


Total 


11.28 


21 








appropriate computer 


Error 


11.27 


20 


.56 


.02 




applications 


Treatment 


.01 


1 


.01' 





* Significant at the .01 level 



As the table shows, Group 1 had a significant positive gain for 
six of the eight Items, while Group 2 had only one significant positive 
gain. However, since Group 2 had high pre-test scores. It Is likely 
that a celling effect occurred, diminishing the possibility of significant 
positive gain. 

On the attitude post-test there were 11 additional Items which 
were Intended to assess the participants reaction to the workshop and 
materials. Means and st&ndard deviations on each of these Items for 
each group are displayed In Table 3. As can be seen from the data, the 
participants had a generally positive attitude toward the workshop and 
materials. In order to determine whether or not there might be a 
difference between the ratings of Groups 1 and 2 a t-test was run on 
all Items. The result showed no significant difference In attitude 
toward the workshop between the two groups. 
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TABLE 3 



Means and Standard Deviations for Items Related 
to Satisfaction with the Workshop and Materials 





Group 1 (N = 


= 11) 


Group 2 (N = 12) 


Questions 


Mean 
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S.D. 


* 9. 


Relevance of 












materials 
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1.6 


.67 


2.3 


1.50 


** 18. 
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difficulty level 


4.4 


1.21 


4.7 


1.30 


19. 


Overall satisfaction 
with workshop and 












materials 


1.9 

1 


.54 j 

i 


2.3 


1.06 



* All items are 7 point rating scales with the positively weighted 
end at 1, except as indicated below. 



** These two items are written so that the most favorable response 
would be the mid-point of the scale, 4. 
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The treatment group received both a pre- and a post-test on the 
Background Booklet Informatloni while the comparison group received only 
a post-test over this material. The results of this testing are presented 
in Table 4. Since the tests were conducted using a matrbc sampling 
technique to allow more thorough coverage of the content, the results are 
reported in terms of weighted averages of the scores on the various forms 
of the test. 

The standard error of the mean and the 95% confidence Interval for 
each sample mean are presented to allow the reader to get an Idea of the 
range In which the true population mean would fall. In addition coefficient 
alpha for each test Is presented to provide the reader with an assessment of 
the Internal reliability of the tests. As can be: seen the reliabilities reported 
are quite respectable for a test that has been developed for a specific 
evaluation study. 

The table also reveals that the pre/post gain for Group 1 was 
significant at the .05 level demonstrating that the Background Booklets 
Improved the participants knowledge of computers. However, none of the 
mean test scores are very high, indicating that the workshop participants 
still were not well acquainted with the Information about computers. 
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TABLE 4 



Results of Background, Booklet Testing Based on Weighted Average 
of the Matrix Sample Taken: Group 1 and Group 2 



Test 


Weighted • 
Average Mean 


Standard Error 
of Mean 


95% Confidence 
Interval 


Coefficient 
Alpha 


Gain 
Score 


t 


Group 1 

(Treatment) 

Pre-test 


28.7* 


1.25 


'26.24-31.15 


.93 






Group 1 

(Treatment) 

Post-test 


34.02 


1.37 


31.33-36.70 


.75 


5.32 


2.91** 


Group 2 

(Comparison) 

Test 


26.50 


1.30 


23.95-29.05' 


.72 







* Scores represent averages for the entire test"53 points possible. 



** Significant at the .05 level. 
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A comparison of the mean score of Group 1 on the background 
post-tests and Group 2 background test (see Table 5), reveals that 
Group I's reading of the Background Booklets prepared them significantly 
better for the workshop than had previous experience with computers 
prepared Group 2. To determine whether this observed difference might 
be due to Group 1 being better prepared for the workshop, a comparison 
of the pre-test of Group 1 with the Group 2 test was done (see Table 5). 
This revealed no significant difference between the two groups prior to 
receiving the Background Booklets. 



TABLE 5 



Comparison of Group 1 and Group 2 Tests 
on Background Booklet Information 



Group 


Mean 


t-Value 


Group 1 
Pre-test 


28.70 


1.167 


Group 2 
Test 


26.50 




Group 1 
^Post-test 


34.02 


5.110* 


Group 2 
Test 


26.50 





* significant at the .05 level 
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The How to Select Units booklet was tested using pre- and post-tests 
for both treatment and comparison groups. The results of this testing are 
presented in Table 6. These results are presented In terms of a weighted 
average of the three subtests which composed the matrix sample taken. 
Again the coefficient alpha's Indicate that the tests are fairly reliable. Both 
groups achieved significant gains from pre- to post-test. However, Group 1 
was lower on both pre- and post-test than Group 2. These differences 
between the two groups were tested and found to be significant. (See Table 7.) 
The question of whether the gains made by the two groups were different 
was also tested. In .this case It was determined that the groups were not 
significantly different In the gains they made over the course of the workshop. 
(See Table 8.) Thus, Group 2 was superior to Group 1 on pre- and post-tests, 
but Group 1 achieved as great a gain from pre- to post-test as did Group 2. 
However, It Is of some concern that neither group achieved a very high 
level of competence on the material covered by the How to Select Units 
booklet, as indicated by the low mean In both cases. 
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TABLE 6 



Results of the "How to Select Units" booklet Testing Based on the Weighted 
Average of the Matrix Sample Taken 



Test 


Weighted 
Average Mean 


Standard Error 
of Mean 


95% Confidence 
Interval 


Coefficient 
Alpha 


Gain 
Score 


t 


Group 1 
Pre-test 


3.414* 


.408 


.614-4.214 


.69 


6.286 


9.589** 


Group 
Post-test 


9.7 


.661 


8.404-10.996 


.65 


Group 2 
Pre-test 


7.17 


.684 


5.829-8.511 


.80 


4.68 


5'. 013** 


Group 2 
Post-test 


11.85 


.642 


10.592-13.108 


.75 



* Scores represent the average for the entire test-18 points possible. 



** Significant at the .05 level. 



TABLE 7 

Hesults of a Comparison of Group 1 and 2 

Pre- and Post-test Means for "How to Select Units'* Tests. 



Group 


Pre-test 


t-Value 


Post-test 


t-Value 


j Group 1 
(Treatment) 


3.414 


4.91* 


9.7 


2.47* 


Group 2 
(Comparison) 


7.17 


11.85 



* significant at the .05 level. 



TABLE 8 

Results of a Comparison of Group 1 and 2 
Gain Scores for the "How to Select Units" Tests 



Group 


Gain Score 


t-Value 


Group 1 
(Treatment) 


6.286 


2.02* 


Group 2 
(Comparison) 


4.68 
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CONCLUSIONS AND RECOMMENDATIONS 

Conclusions 

The data and results described above have led to the following 
conclusions for each focus of the summative evaluation. 

Question 1; Are the objectives of the system attained? 

Pre/post gains scored by Group 1 on the Instrument measuring 
attainment of objectives for the background materials were significant. 
(See Table 4 above.) Thus, it may be concluded that Group 1 did Indeed 
attain the objectives of the Background Booklets. 

Significant gains on the Instrument measuring attainment of 
objectives of the How, to Select Units booklet were achieved for Group 1 
and Group 2. Thus, It Is reasonable to conclude that both groups achieved 
the Instructional objectives of the booklet. Although Group 2 scored higher 
than Group 1 on both the pre- and post-tests, the difference In gain between 
the two groups Is not statistically significant. This suggests that persons 
already familiar with computers, who receive Instruction In the How to 
Select Units booklet without benefit of Background Booklets, may be expected 
to learn as much as persons who receive the Background Booklets, prior to 
instruction in the How to Select Units booklet. This implies that the 
Background Booklets effectively provide the needed information to prepare 
the participants to use the How to Select Units. Measures of the attitudinal 
objectives of this system showed that Group 1 showed a significant gain for 
six of the eight items (see Table 1), yielding the conclusion that 75 percent 
of the attitudinal objectives were attained. For Group 2, as suggested above, 
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a ''ceiling" effect may have occurred, since the group scored quite high 
on the pre-test and recorded only one significant gain on the post-test* 

Question 2: How do the Background Booklets compare with a 
critical competitor? 

As described above, the Mankato State Seminar was deemed a 
competitor with the Background Booklets. The testing would determine 
whether the Background Booklets would prepare a group of teachers for 
the How to Select Units booklet better than a college course would 
prepare another group of teachers. 

Analysis of gains on the instrument measuring achievement of the 
How to Select Units objectives showed no significant differences (see 
Table 7) in gain scores. It may thus be concluded that while both groups 
appeared to master the objectives, there Is no evidence that either mode 
of preparation (booklets or college course) Is superior. Further, these 
data would support the conclusion that the How to Select Units may be 
used independently, with a group who is knowledgeable In the area of 
computers. 

Question 3; Are there important side effects? ' 

For purposes of this evaluation, a side effect is defined as an 
unexpected or unplanned outcome of the product, or as outcomes other 
than those specified in the products' goal statements. 
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Developers, evaluators and the instructors at the test sites 
Identified the following possible side effects of the materials: 

1. Participants would develop classroom CEI applications 

2. Participants would further pursue their education in the area 
of computers — workshop participation and college courses 

3. Participants would agitate for greater computer access 

4. Participants would spread enthusiasm for using computers 
among fellow teachers 

5. Participants would learn more about using computers 

6. Participants would develop teacher communication 
networks about computers. 

7. Participants would create pro-computer pressure groups 
within educational structure 

8. "Immediate*' side effects are: 

a. Increased sociability among teachers 
in workshops 

b. Idea exchange 

c. Awareness of computer information 
resources 

Side effects 1 through 7, above are long-term in nature and it is 
not reasonable to expect that they be immediately observable. Since it 
would require observation over considerable periods of time (one year or 
more), to determine whether any of these had taken place, and since 
there is insufficient time within the existing contract for observations of 
such a length, it is not possible to explore these possible side effects. 
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Recommendations 

On the basis of data gathered during the field test it was recommended 

that: 

1. Certain content changes be made , 

2. A publisher for the materials be sought. 



46 



37 



APPENDIX A: OBJECTIVES OF 
THE MATERIALS 
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OBJECTIVES 



Hardware at a Glance 

1. List the three essential pieces of hardware for a computer system. 

2. Distinguish between Interactive and batch modes of processing. 

3. State the advantages and disadvantages of Interactive processing. 

4. Recognize some commonly used Input/output devices. 

5. Define what is meant by "time-sharing." 

6. Describe how a program is activated for use in terms of the 
computer's working memory and computer storage. 

7. Explain what happens to a program when the user signs off the 
terminal. 

8. Know where to obtain advice as to whether or not your computer 
is large enough to run a given program. 

Software at a Glance 

1. List at least three sources of user's programs available to you. 

2. Identify three common ways to loading a program for use. 

3. Describe two common ways a program can be "stored" for use in 
your classes. 

4. Identify the differences between machine language and programming 
languages. 

5. Describe the function of translators In the computer's software system 

6. Explain the main reason why there are many different programming 
languages. 

7. State the three fundamental elements Involved In computer programs. 
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8. Given a simple program In any of the languages commonly used 
In Instructional programs — 

o Identify the input Instructions 

o Identify the processing Instructions 

o Identify the output. Instructions 

o Identify the control Instructions 

o Identify the programmer's remarks 

o Determine the general purpose of the program 

9. Follow a simple BASIC program dealing with a subject In your 
discipline and understand the main steps It goes through In 
processing Input and producing output. 

The Roles of the Computer In Instruction 

1. Name the five major roles of the computer In Instruction. 

2. State the distinguishing characteristics of programs which use the 
computer In each of the five major roles. 

3. Given a sample Interaction with a program, determine which computer 
role Is used. 

4. Explain how computer roles may overlap In a single instructional 
program, 

5. Determine which computer roles would be appropriate for specific 
Instructional situations. 

6. Identify the functions of computer-managed Instruction (CMI). 

7. Identify the main characteristics of the inquiry mode of computer use. 
Computers In the Curriculum: A Book of Readings 

The objectives are met by and throughout each article. 
How to Select Units 

1. List five critical aspects of a computer-enhanced unit which should 
be examined at the Initial stage In selecting units for classroom use. 

2. For each of the initial critical aspects of a unit, explain why it is 
critical in the selection process. 

3. List at least five final aspects of a unit which should be considered 
in making final decisions on units. 
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4. Describe or explain what the terms **student proof" and "user 
oriented" mean In terms of programs. 

5. Discuss how the number of variables and the number of options 
In a computer program relate to the program's utility In the 
classroom. 

6. Identify three time/cost factors Involved In using computer-enhanced 
units In classroom Instruction. 

7. Given computer-enhanced curriculum units Ln your field of teaching: 

o Determine If the hardware and software requirements make 
the units feasible for use 

o Determine If the objectives, materials, and models are 
suitable for your use 

o Rate the units on at least five final variables 

o Select the unit(s) which will best suit your needs 
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APPENDIX B: QUESTIONNAIRES 
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ID 



(Last 4 Digits of Social Security Number) 



Date 



Form S-1 



Directions 

On the following pages are three types of questions — flll-ln-the-blank, 
short essay and multiple choice. Please respond to each t3Tpe 
appropriately and always use the best answer. It Is not necessary to 
guess since performance on this test will only be used to determine the 
average class performance. 

There is no time limit for this test. 



Suppose that In trying out a computer-enhanced unit that It takes 
approximately four hours of terminal time to wox* through the unit, 
that the program detects typing errors, that there are 10 user- 
controlled variables and that Input and output Is fully explained. 
The acceptability of this unit might be called Into question because 
of: 

a. the degree to which the unit Is student proof 

b. an Insufficient number of user-controlled variables 

c. the time and cost consideration of using the computer 

d. the number of options available for student use 



If a computer-enhanced instruction unit does not describe the algorithm 
or model used In the program most probably It falls to meet the 
^criterion. 



If a CEI program appears to be a rigid. Inflexible package which the 
user can Interact with in only one, pre-determlned way. It does not 
have high classroom utility because It does not meet the final 
decision of criterion of 



Suppose that you were an el^h grade mathematics teacher and you were 
looking for computer-enhanced Instruction units to use in your class. One 
that you have found is used to do addition problems. This unit would 
probably: 

Be student proof 
Not enhance Instruction 

Have a number of variables controllable by the student 
Enhance Instruction 



If a program will not run on your computer system because FORTHAN 
Is not available. It has not met the criterion. 
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6. If a computer-enhanced Instruction unit consists of only a program 
listing It probably does not meet the ^criterion. 



ED 



(Last 4 Digits of Social Security Number) 



Date 



Form S-2 



Dlrectloas 

Oa the following pages are tliree types of questlons~flll-ln-the-blank, 
short essay and multiple choice. Please respond to each type 
appropriately and always use the best answer. It Is not necessary to 
guess since performance on this tc^st will only be used to determine the 
average class performance . 

There Is no time limit for this test. 
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1, 



If a computer-enhanced Instruction unit will not run on your computer 
because the computer does not have enough storage, It has not met the 
criterion. 



ERIC 



List five aspects of a CEI unit which should be used In the Initial 
evaluation of a computer-enhanced unit. 



If a computer-enhanced instruction unit consists of only a BASIC 
program which requires an interactive computer with at least 3000 
memory locations and you have access to a computer that operates 
in the interactive mode and has 4000 memory locations, the unit, as 
it stands probably is; 



e. 



a, not written in an acceptable language 

b. capable of running on your computer 

c. acceptable in terms of support materials 

d, not capable of running on your computer 
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4. 



List three time/cost factors Involved In using computer*-enhanced units 
tn the classroom 



c. 



5. If a data analysis program calculates correlations and you want your 

student to determine averages It most probably falls the 

criterion. 



6. It a computer-enhanced instruction program does not check for an 
acceptable range of values for the Input It most probably does not 
meet the final decision criterion of 
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ID 



(Last 4 Digits of Social Sectirlty Number) 



Date 



Form S-3 



Direct logs 

On the following pages are three types of questions — flll-la-the-blank, 
short essay and multiple choice. Please respond to each t3rpe 
appropriately and always use the best answer. It Is not necessary to 
guess since performance on this test will only be usetf'to determine the 
average class performance. 

There Is no time limit for this test. 
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If a single unit Is useful to the teacher In achieving a number of 
objectives, It Is said to meet the final decision criterion of having 
several . 

If a computer-enhanced Instruction program has a brief but easy to 
understand output, It probably meets the final decision criterion of 



List five aspects of a CEI unit which should be considered in making 

a final decision on a computer-enhanced unit, 

> 

a. 



b. 



c. 



d. 



e. 



Assume that you are a seventh grade social studies teacher. You are 
searching for a computer-enhanced unit to help teach your class map 
concepts, la the course of your searching you find a unit called GEOGBF. 
In the teacher's manual for GEOGRF you find that the program which 
requires 4000 storage locations and Is designed to teach students the 
capitals of each of the states in the U.S. by drill and practice. In this 
case the coirputer-enhanced unit would probably: 



a. be able to run on your computer 

b. have objectives compatible with yours 

c. nc^^ be student-proof 

d. not have objectives consistent with yours 
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If a computer -enhanced instruction unit gives practice in translating 
French to English and you want to teach translation from English 
to French, this unit has not met the ^criterion. 



Suppose that you are a 10th grade general science teacher. You are 
looking for a computer-based Instruction unit to teach about the 
causes of air pollution. You have just found a unit called AIRPOL. 
The model used in AIRPOL yields an air pollution Index based on the 
level of Industrial production but does not Include automobiles. This 
would not be acceptable because the model Is: 

a. not complete enough 

b. based on reality 

c. too complex 

d. a math model , 
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ID 

(Last 4 Digits of Social Security Number) 

Date 



Form B-1 



Directions 

On the following pages are three types of questions — flU-ln-the-blank, 
short essay and multiple choice. Please respond to each type 
appropriately and always use the best answer. It Is not necessary to 
guess since performance on this test will only be used to determine the 
average class performance. 

There Is no time limit for this test. 
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After signing off the computer termlnal> the program which was used 

Is: 



a. Erased from the working area and saved In the storage area 

b. Erased from both. the working area and the storage area 

c. Saved In both the working area and the storage area 

d. Erased from the storage area and saved In the working area 



The 



mode for the computer is characterized as a 



learner controlled* responsive learning system, 

a« socratic 

b. problem-solving 

c. discovery 

d. inquiry 



What kind of input/output device is pictured below? 




a. CRT 

b. Line Printer 

c. Teletype 

d. Card Beader 




The two most common ways of storing a computer progi-am are: 

a. ^_ 

b. 



The role of the computer In instruction Is 

most appropriate when students are to collect Information, statistically 
analyze it and evaluate the results. 
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The ^role of the computer in instruction is most 

appropriate when students must write a program to find the solutions to 
a quadratic equation. 



List three specific currlcular topics In your curriculum specialty 
In which computer-enhanced units would be helpful. 



a. 



b. 



c. 



The difference between ' 

Is that one Is "imderstood" by the computer and the other Is used 
by most users. 

a. machine languages and assembly languages 

b. FORmula TRANslatlon and Beginners All-purpose Symbolic 
instruction Code* 

c. '*Engllsh-llke" programming languages and machine languages. 

d. the ALGO rltbmlc Language and COmmon Business Oriented 
Language " 

The three ways of loading a program for use are 9 

and ' . 

a. Loading punched cards, loading a punched paper tape, typing 
at a computer terminal. 

b. Typing at a computer terminal, loading punch cards J typing 
at a keypunch, 

c. loading a punched paper tape, typing at a keypunch, loading 
marked cards. 

d. loading a magnetic tape, loading marked cards, typing at a 
keypunch. 
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Is the Instructional role of a computer 
In which the computer prints out a series of problems such as 
"5 4- 4 = , 9 + 2 = , and 11 + 3 = " and evaluates student'^ 
answers. 



Your local computer expert can provide a number of services. An 
Important one of these services is: 

a, advising you whether or not a specific program meets your 
instxiictional needs, 

b, telling you if a specific program wlll~run on a specific computer, 

c. informing you of the instructional objectives of a program. 

d. instructing you about the computer's accounting routines. 



The ^role of the computer In Instruction Is most 

appropriate when attempting to teach about plant growth by 
means of a mathematical model, which represents a plant growth 
system. 



Is the instructional role of a computer 

In which It can be uspd to find the area of a triangle. 



ID 



(Last 4 Digits of Social Security Number) 



Date 



Form B-2 



Directions 

On the following pages are three types of questions — flll-ln-the-blank, 
short essay and multiple choice. Please respond to each type 
appropriately and always use the best answer. It Is not necessary to 
guess since performance on this test will only be used to determine the 
average class performance. 

There Is no time limit for this test. 
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state one disadvantage of the Interactive mode. 



The three main functions of Computer-Managed Instruction systems are to: 

a. store student records, tutor the student and analyze student 
progress 

b. store student records, analyze student progress and direct 
the learning sequence, 

c. ask the student a question, evaluate his response and record 
the student's performance, 

d. present information to the student, ask the student questions 
and record the students responses. 

Which of the examples given below Is the best example of role overlap? 

a. A computer-enhanced Instruction unit on cell growth which 
calculates the average growth rate of 100 different cells and uses 
this Information t€ provide original Instruction about cell growth. 

b. A computer-enhanced Instruction unit which calculates the aveiages 
and standard deviations of two groups of data and then prints out 
the average difference, the statistical significance of that average 
and the correlation between the two groups. 

c. A computer-enhanced Instruction unit on the International banking 
system In which a set of mathematical equations are used to 
predict what will happen In such cases as when the U.S. sells a 
billion dollars worth of wheat to the U.S.S.R. 

d. A computer-enhanced Instruction unit In which persons Interacting 
with the computer to learn the various roles In modem city 
government , the functions of those roles and who presently 
occupies those roles In your city. 



^is the instructional role of a computer in which 

the student uses the computer to examine the results of a survey which 
he has conducted. 
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5* The three sources of computer programs available to you are; 

at_ 

b. 



c. 



6. The two primary advantages of the batch processing model are 
that: 

a. It Is relatively Inexpensive and handles large volumes 
of data efficiently. 

b. users are actively Involved and they get Immediate 
feedback. 

c. It Is relatively Inexpensive and users get Immediate 
feedback. 

d. users are actively Involved and large volumes of data 
are handled efficiently. 



7« When It Is desired for the computer to teach a concept as well as 

provide practice, the ^role of the computer 

In Instruction Is most appropriate. 



8. If a computer program Is set up so that It requires that a response 
be given by the user at various times It Is most likely to be 
operating In the mode. 

a. problem solving 

b. Interactive 

c. batch 

d. data analysis 



67 



58 



The computer-based Instruction unit from which this output came was 
most probably a }^^^^' 



>RUN 

HELLO, MY NAME IS CHARLIE. 

TYPE YOUR NAME 

?KELLY 

TYPE THE NUMERATOR OF THE FIRST FRACTION 

?1 ' , . 

TYPE THE DENOMINATOR OF THE FIRST FRACTION 

?2 

TYPE THE NUMERATOR OF THE SECOND FRACTION 
?3 

TYPE THE DENOMINATOR OF THE SECOND FRACTION 
?4 

TYPE THE DENOMINATOR OF YOUR ANSWER • 
?6 

INCORRECT. FIRST FIND A COMMON DENOMINATOR BY MULTIPLYING 

BOTH THE DENOMINATORS TOGETHER. 

TYPE YOUR ANSWER TO THIS MUCH OF THE PROBLEM. 

?6 - 

INCORRECT. FIRST FIND A COMMON DENOMINATOR BY MULTIPLYING 
BOTH DENOMINATORS TOGETHER. 

TYPE YOUR ANSWER TO THIS MUCH OF THE PROBLEM. 
?8 

MULTIPLYT-HE NUMERATOR AND DENOMINATOR OF THE FIRST FRACTION 
BY THE DENOMINATOR OF THE SECOND FRACTION 
TYPE THE NUMERATOR OF YOUR NEW FRACTION 
?2 

INCORRECT 
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10. Look over the program listing below and answer the following 
question. 

lO.EEM THIS IS A SAMPLE PROGRAM 

20 REM IN ORDER TO RUN THIS PROGRAM 

30 REM TYPE GET-SAMPLE AND RUN 

35 DIM A(20) 

40 INPUT A$,G1,G2,G3 

50 B=(Gl+G2+G3)/3 

60 IF B>3.5 GO TO 90 , 

70 PRINT "STUDENT", A$,"GPA=",B 

80 GO TO 40 

90 PRINT "STUDENT",A$,"GPA=",B, "HONOR ROLL" . 
100 GO TO 40 
110 END 



What is the line number for the Control Instruction? 



11. List three roles the computer can play In your curriculum 
specialty. 

a. 



b. 



c. 



ERIC 
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The computer^aaed instruction unit from which thia output came was. 
most probably a ^unLt. 

PLEASE ENTER YOUR STUDENT NO. ? 5331 

WELL BOBBY , HOW MANY PROBLEMS DO YOU WANT?5 

FOR EACH OF THE FOLLOWING NUMBERS TYPE EACH OF THE 

FACTORS SEPARATED BY COMMAS. 

51 

? 51,17,8,1 

CORRECT 

36 

?36,18,12,9,6,3,2,1 

CORRECT 
29 ■ ' 

?29,7,4,1 

NO, THE FACTORS OF 29 ARE 29, 1 ' 
20 

720,10,5,4,1 

CORRECT 

44 

744,22,11,4,2,1 
CORRECT 

YOU GOT 4 OUT OF 5 CORRECT 



The function of a BASIC translator Is to translate: 

a. ALGOL Into BASIC 

b. Machine language into BASIC 

c. BASIC into an "English-like" programming language 

d. BASIC into machine language 



70 



61 



ID 



(Last 4 Digits of Social Security Number) 
Date A' 



Form B-3 



Directions 

On the following pages are three types of questions — flll-ln-the-blank, 
short essay and multiple choice. Please respond to each type 
appropriately and always use the best answer. It Is not necessary to 
guess since performance on this test will only be used to determine the 
average class performance. 



There Is no time limit for this test. 



1. , Look over the program listing below and answer the 
following question. 



10 BEM THIS IS A SAMPLE PROGRAM 

20 REM IN ORDER TO RUN THIS PROGRAM 

30 REM TYPE GET-SAMPLE AND RUN 

35 DIM A(20) 

40 INPUT A$,G1,G2,G3 

50 B~=(Gl+G2+G3)/3 

60 IF .B>3.5 GO TO 90 

70 PRINT "STUDENT",A$,"GPA='VB 

80 GO TO 40 

90 PRINT "STUDENT",A$,"GPA=",B, "HONOR ROLL" 
100 GO TO 40 
110 END 

What is the line number for the following instruction? 
Programmers remark 



2. The computer-based instruction unit from which this output came was 
most probably a unit. 

>RUN 

VOICI UNE PROGRAMME EN FRANCAIS. MALHEUREUSEMENT, CETTE 

MACHINE N'E^T PifLl EN FRANCAIS. DONC IL N»Y AURA PAS D 'ACCENTS OU 

D'AUTRES CHOSES FRANCAIS. 

BONNE CHANCEi: 

COMMENT VOUS APPELEZ-VOUS? 

7MARIE DUPONT 

QUELLE PHRASE CELERRE DANS «LA FARCE DE MAITRE PATHELIN 

»VEUT DIRE«RENTRONS A NOTRE SUJET»? 

?BE 

EXACTEMENTII 

QUEL ROI ETAIT «SAINT LOUIS»? 
?LUiOUIS IX 

EXACTEMENT CORRECTEI I 
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^Is the iostxructloaal role of a computer in 

which a model of reality is ojoerated. 



Look over the program listing below and answer the following 
question. 

10 BEM THIS IS A SAMPLE PROGRAM 

20 REM IN ORDER TO RUN THIS PROGRAM 

30 REM TYPE GET-SAMPLE AND RUN 

35 DIM A(20) 

40 INPUT A$,G1,G2,G3 

50 B=(Gl+G2+G3)/3 

60 IF B>3.5 GO TO 90 

70 PRINT "STUDENT", A$,"GPA=",B 

80 GO TO 40 

90 PRINT "STUDENT",A$,"GPA=",B, "HONOR ROLL" 
100 GO TO 40 
110 END 

What is the line number for the Output Instruction? 



List the five major roles of the computer in instruction. 

1. 

2. 

3. 

4. _ 

5. 

In order to obtain information about running a program on a specific 
computer you probably should: 

a. Try running the program 

b. Consult your local computer expert 

c. Consult the relevant computer manuals 

d. Go to the library 



Look over the program listing below and answer the following 
question. 

10 REM THIS IS A SAMPLE PROGRAM 
20 REM IN ORDER TO RUN THIS PROGRAM 
30 REM TYPE GET-SAMPLE AND RUN * 
35 DIM A(20) 

40 INPUT A$,G1,G2,G3 ' 
50 B=(Gl+G2+G3)/3 
60 IF B>3.5 GO TO 90 
* 70 PRINT '»STUDENT",A$,"GPA=",B 
80 GO TO 40 

90 PRINT "STUDENT",A$,"GPA=",B,»BONOR ROLL" 
100 GO TO 40 
110 END 

What Is the line number for the Iriput Instruction? 



What kind of input/output device is pictured below? 




a* CRT 

b. Line Printer 

c. Teletype 

d. Card Reader 



The main reason that there are many different programming 
languages Is that: 

a. There are many different kinds of computers. 

b. Each manufacturer of computers has created programming 
languages which are unique to his particular machine. 

c. Programmers need to accomplish a large number of 
different tasks. 

d. Each of the major fields of computer use has Its own 
particular vocabulary and computational needs. 

74 



10. List three specific currlcular topics In your curriculum specialty 
In which computer-enhanced units would be helpful. 



a. 



b. 



c. 



11. The computer-based instruction unit from which this output came was 
most probably a ^unlt. 

ARE YOU STARTING A NEW GAME(1=YES, 2=NO)?l 

YOU ARE A 21 YEAR OLD BLACK MALE. ' * 

AT THE PRESENT TIME YOU ARE UNEMPLOYED AND ARE NOT MARRIED. 
YOU HAVE A PRIOR POLICE RECORD AND COME FROM A BROKEN HOME. " 
YOU HAVE NO FATHER AND YOUR MOTHER IS ON WELFARE. 
YOU HAVE AN 8TH GRADE EDUCATION AND YOUR TOTAL ASSETS ARE $700 

YOU HAVE BEEN ACCUSED OF MANSLAUGHTER. 

PLEASE SELECT ONE OF THE FOLLOWING LAWYERS: 

1. WHITICAR: HIGH QUALITY AND EXPERIENCED. COST = $200. 

2. SWEENEY: LOW QUALITY AND INEXPERIENCED. COST = $100. 

3. FRANKLIN: PUBLIC DEFENDER. COST = $0 
WHICH LAWYER DO YOU WANT71 

YOU NOW HAVE $500 

YOUR BAIL HAS BEEN SET AT $300. DO YOU WISH TO PAY IT (1=YES, 
2=NO)?l 

YOU NOW HAVE $200 
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12. What kind of terminal Is pictured below? 




a. Teletypewriter 

b. LTV 

c. CRT 

d. Line Printer 



The computer-based instruction unit from which this output came was 
most probably a unit. 

ENERGY IS A DEPICTION OF THE ENERGY CRISIS IN THE UNITED 
STATES. YOU WILL TRY TO SOLVE THE ENERGY PROBLEM BY 
CHANGING THE BEHAVIOR OF THE AMERICAN PEOPLE, OF 
BUSINESSES AND INDUSTRIES AND SO FORTH. YOU SHOULD TRY 
TO BALANCE THE DEMAND FOR ENERGY WITH THE AVAILABLE 
SUPPLY. FROM TIME TO TIME UNEXPECTED EVENTS WILL OCCUR 
WHICH WILL REQUIRE YOU TO VARY YOUR STRATEGY. 

SINCE THIS IS A VERY SIMPLE MOP^'L OF A COMPLEX PROBLEM 
YOU WILL NOT BE ABLE TO CON . AS MAInY FACTORS AS YOU 
MIGHT LIKE. 

AT THE END OF EACH YEAR YOU WILL BE GIVEN A.iREPORT. THIS 
REPORT WILL DESCRIBE THE CONSEQUENCES OF YOUR ACTION. 

YOU WILL BE ABLE TO CHANGE 10 FACTORS. TO INCREASE THE 
FACTOR ENTER A POSITIVE NUMBER. TO DECREASE THE FACTOR 
ENTER A NEGATIVE (-) NUMBER. IN EITHER CASE, THE HIGHER 
THE NUMBER THE GREATER THE' IMPACT. 



POLLUTION LEVEL 
ECONOMIC WELL-BEING 
GENERAL SATISFACTION 

O 

ERIC 



INDEX 
18 
15 
26 
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14. The role of the computer In instruction is 

most appropriate when students need to review and apply skills 
and concepts they have learned elsewhere. 
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ID _^ 

(Last 4 Digits of Social Securlly Number) 

Date 



Form B-4 



Dlreetloas 

On the following pages are three types of questions — flll-ln-the-blank, 
short essay and multiple choice. Please respond to each type 
appropriately and always use the best answer. It Is not necessary to 
guess since performance on this test will only be used to determine the 
average class performance. 

There Is no time limit for this test. 
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l.i : Is the Instructional role of a computer In 

which original Instruction Is provided as well as questions and evaluation 
of responses. 

2. ; List the the three fundamental elements of a computer program: 

a._ 

b. 



3. The computer-based instruction unit from which this output came was 
most probably a ^unlt. 

DO YOU WANT A DESCRIPTION OF THIS PROGRAM 
?YES 

THIS PROGRAM COMPUTES SETS OF PAIRS X,Y 
THAT SATISFY A QUADRATIC FUNCTION OF THE FORM: 
Y = A*X+2.*B*X+C 

IT EVALUATES THE FUNCTION FOR EACH VALUE OF 
X IN THE INTERVAL WHICH HAS A LOWER HMIT OF X(l) 
AND AN UPPER LIMIT OF X(2), WITH AN INCREMENT(OR 
STEP SIZE) OF 1. 

♦ 

ENTER VALUES FOR A,B, AND C ON ONE LINE, 

USING COMMAS TO SEPARATE THEM. 

?5,7,6 

ENTER VALUES FOR X(l), X(2), AND 1 

ON ONE LINE, USING COMMAS TO SEPARATE THEM. . 

?1,10,1 

FUNCTION: Y = 5*X+2*7*X+6 
X Y 

1 18 

2 40 
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4. 



List three roles the computer can play In your curriculum 
specialty. 



a. 



b. 



c. 



5. The three ess.<,utLal pieces of hardware for a computer system 
are: 



a. 



b. 
c. 



6. Look over the program and answer the following question. 



10 BEM THIS IS A SAMPLE PROGRAM 

20 REM IN ORDER TO RUN THIS PROGRAM 

30 REM TYPE GET-SAMPLE AND RUN 

35 DIM A(20) 

40 INPUT A$, Gl, G2, G3 

50 B^(Gl+G2+<;3)/3 

60 IFB>3.5 GO TO 90 

70 PRINT "STUDENT", A$,"GPAi='VB . ' 

80 GO TO 40 

90 PRINT "STUDENT",A$,"GPA=",B , "HONOR ROLL" 
100 GO TO 40 
110 END 



ERIC 
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Give the output of this program as It would appear on a computer 
terminal If the Information below were typed on the teletypewriter. 



J. YOUNG, 3, 4, 4 
P. SMITH, 2, 2, 3 



7. The computer-based instruction unit from which this output came was 
most probably a u nit. 

BESFIT 

HOW MANY PAIBS OF VALUES DO YOU HAVE? 
?5 

AFTER EACH QUESTION MARK ENTER ONE PAIR OF VALUES. 

?1,1 

?2,2 

?3,3 

?4,4 _ - . ' 

75,5 

BEST LINE. EQUATION IS Y = 1 X + O 

WOULD YOU LIKE TO ENTER NEW VALUES? 
?N0 



When someone calls a computer program from the computer, the 

program must be taken from 

and loaded Into . 



The computer-based instruction unit from which this output came was 
most probably a ^unlt. 

IN THIS LESSON WE WILL LEARN ABOUT THE NOUN AS A 
PART OF SPEECH. 

DEFINITION: NOUN-A NAME OF SOMETHING 
EXAMPLE; THE DOG'rAN AWAY. 

DOG IS A NOUN BECAUSE IT IS A NAME 
NOW YOU TRY ONE. WHAT IS THE NOUN IN THIS SENTENCE? 

JANE CRIED QUIETLY. 

?JANE 

CORRECT, LETS TRY ANOTHER ONE, WHAT IS THE NOUN IN 
THIS SENTENCE? 

HERE COMES THE CAT. 

?HERE 

WRONG. A NOUN IS NOT ALWAYS THE FIRST WORD IN A 
SENTENCE. REMEMBER, NOUNS ARE WORDS WHICH NAME 
SOMETHING. IN THIS SENTENCE THE WORD WHICH NAMES 
SOMETHING IS? CAT 

CORRECT, LETS TRY ANOTHER ONE. WHAT IS THE NOUN 
IN THIS SENTENCE. 



82 



73 



10. The computer-based InatructioQ unit from which this output oav/ie was 
most probably a _unlt. 



WOULD YOU LIKE A PROGRAM DESCRIPTION? . 
YES 

THIS PROGRAM WILL CALCULATE AN ASSET'S ANNUAL AND TOTAL 
DEPRECIATION WHEN ASSET'S NAME, COST, YEARS USED, .NI. 
DISPOSAL VALUE ARE SPECIFIED. 

IN ADDITION, IT CAN PRINT OUT A TABLE SHOWING THE DEPRECIATION 
EXPENSE, ACCUMULATED DEPRF.aATTON, AND THE BOOK VALUE FOR 
EACH YEAR DURING THE USE OF T' ASSET;;- 

WHEN ASKED 'DO YOU WANT A TAf „... ' ENTER YES OR NO. 

ASSET NAME? 
?DEsk 

COST? . . 

?2500 

ESTIMATED LIFE (IN YEARS)? 
?6 

DISPOSAL VALUE? • 
?100 

TOTAL DEPRECIATION = 2400 
• ANNUAL DEPRECIATION = 400 



11. Time-sharing is when: 

a. The computer executes two or more programs at the same time 

b. Two or more persons use tbf? same terminal for running 
programs 

c. Two or more users share using a computer 

d. Two or more terminals are connected to the computer 
simultaneously. 
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12. Look over the program listing below and answer the following 
questions. 

10 REM THIS IS A SAMPLE PROGRAM 

20 REM IN ORDER TO RUN THIS PROGRAM 

30 REM TYPE GET-SAMPLE AND RUN 

35 DIM A(20) 

40 INPUT A$,G1,G2,G3 

50 B=(Gl+G2+G3)/3 

60 IF B>3.5 GO TO 90 

70 PRINT "STUDENT", A$,"GPA=",B 

80 GO TO 40 

90 PRINT "STUDENT",A$,"GPA=",B, "HONOR ROLL" 
100 GO TO 40 
110 END 

What is the line number for the Processing Instruction? 



IG. . In the space below describe the purpose of this program 



APPENDIX C: ATTITUDE QUESTIONAIRES 
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ID 



(Last 4 digits of your Social Security No 



Date 

QUESTIONNAIRE SA 

Directions 

This r4uestlonnalre Is designed to determine some prevalent attitudes about the 
use of computers In Instruction. All responses will be anonymous. Each item 
is followed by a seven step scale from one extreme to the other. Please 
Indicate your response to the Item by placing an X at one of the spaces on the 
scale that corresponds most closely to your feeling. 

1. Eor purposes of teaching the computer Is . 

Highly useful //////// Useless 

2. I know ways of using the computer in the classroom. 

Many /////'/// Hardly any 

3 T feel \ ^about using the computer as an Instructional tool 

in the classroom. 

Very confident /////// / Quite unsure 

4. I ai^ to use the computer Ln my te.u?hlng. 

Eager //////// Unwilling 

5. How woi.-id you characterize your competence In making use of a 
computer ^^s 9^ tastructlonal tool? 

Consicl^r^^Ui / _J_ i / / / / / Negllgable 

6. I know of _ _ ways that I can use the computer in my teaching. 

Numerous L L ZL..-^L.... i / / / Few 

7. I plan to use the computer in my work. 

Of:-n / / / / / / / / Seldom 

S. liow would you describe your ability to choose useful and appropriate 
computer appHcallons for your class? 

Very good //////// Very poor 
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9. The materials that were the subject of this workshop were 
^ to me as a teacher. 

Hlghlv jievant /////'/// Completely Irrelevant 

10 The ; raatlon that these materials presented will be generally 
^In my job. 

Very useful /////// / Useless 

11. I learned ^from this workshop. 

A great dea l/ ////// / Very little 

12. There was time allowed for learning the 

Information presented In this workshop. 

Too muc h/ ////// / Too little 

13. The materials used In this worshop were 

examples of educational materials. 

Excellen t/ ////// / Poor 

14. The information and skills that I learned In this workshop will be 

^to me In the classroom. 

Veiy valuable / /////// Worthless 

15. There are _that I can Immediately use what I 

have learned In this workshop. 

Many ways / ////// / No ways 

16. These materials will be ^future reference. 

Valuable/ / ///// / Worthless 

17. I would be ^to recomxuond this workshop to 

my fellow teachers. 

Very eager / ////// / Extremely reluctant 

18. The overall difficulty level of this workshop was 



Very- difficult / ////// / Very easy 
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19. My overall satisfaction with the workshop and materials can be 
characterized as [ • 

Very great / ////// / Very little 

20. Check the box which corresponds to your level of experience with 
the compater. 

[ I no experience 

j j some experience (have used computers before) 

I I moderate experience (have written simple programs) 

I j experienced (know a programming language and are^ capable 
— of writing classroom applications) 

21. Circle the grade (s) of your primary teaching responslbaiLy(les): 

K 1 2 3 4 5 6 7 8 9 10 11 12 12+ 

22. What is/ai-e your subject matter speclalty(ies): 

a. 

b. 



d. 



'j3. What is your level of education 
Q B.A., B.S. 
Q B.A.+, B.S.+ 
[~| M.A. , M.S. 
I I M.A. +, M.S.+ 
I I Ph.D. 

24. How many years of teaching e>?ierience do you have?_ 



FRir 



88 79 



(Last 4 digits of your Social Security No. 
Date 



QUESTIONNAIRE SB 

Directions 

This questionnaire Is designed to determine some prevalent attitudes about the 
use of computers in Instruction. All responses will be anonymous. Each Item 
Is followed by a seven step scale from one extreme to the other. Please 
Indicate your response to the Item by placing an X :d one of the spaces on the 
scale that corresponds most closely to your feeling. 

1. For purposes of teaching the computer Is . 



Highly useful //////// Useless 

2. I know ^ways of using the computer In the classroom. 

Many /// ///// Hardly any 

3. I feel about using the computer as an instructional tool 

in the classroom. 

Very confident //////// Quite unsure 

4. I am to use the computer in my teaching. 

i:-iger //////// Unwilling 

5. How svould you characterize your competence in making use of a 
computer as an Instructional tool? 

Considerable Z /////// Negligable 

6. I know of ways that I can use the computer in my teaching. 

Numerous //////// Few , 

7. I plan to use the computer In my work. 

Often //////// Seldom 

S. How would you describe your ability to ohoose useful and appropriate 
computer applications for your class? 

Very good //////// Very poor 
O Q Q SO 
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9. The materials that were the subject of this workshop were 
_to me as a teacher. 

Highly relevant //////// Completely Irrelevant 

10. The Information that these materials presented will be generally 
In my job. 

Veiy useful /////// / Useless 

11. I learned ^from this workshop. 

A great dea l/ ////// /Veiy little 

12. There was time allowed for learning the 

Information presented In this workshop. 

Too muc h/ /////// Too little 

13. The materials used In this worshop were 

examples of educational materials. 

Excellent / ////// / Poor 

14. The information and skills that I learned in this workshop will be 
^to me In the classroom. 

Veiy valuable / ////// /Worthless 

15. There are that I can Immediately use what I 

have learned In this workshop. 

Many ways / ////// /No ways 

16. These materials will be a future reference. 

Valuable / ////// / Worthless 

17. I would be to recommend this workshop to 

my fellow teachers. 

Veiy eager / ////// / Extremely reluctant 

18. The overall difficulty level of this workshop was 

Very difficult / /////// Very easy 
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19. My overall satisfaction with the workshop and materials can be 
characterized as . 

Veiy great / ////// / Very little 

20» Check the box which corresponds to your level of experience with 
the computer. 

j I no experience 

j j some experience (have used computers before) 

[ I moderate experience (have written simple programs) 

I I experienced (know a programming language and are capable 
of writing classroom applications) 

21. Circle the grade (s) of your primary teaching ^ponslblllly(les): 

K 1 2 3 4 5 6 7 8 9 10 11 . 13 12+ 

22. What Ls/are your subject matter specialty (les): 

a. 

b. 

c. 

d. 

23. What Is your level of education 

B.A., B.S. 
I I B.A. + , B.S.+ 
P] M.A. , M.S. 
I ] M.A. +, M.S.+ 
[~].Ph.D. 

24. How many years of teach Lng experience do you have?_ 
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(Last 4 digits of your Social Security No. 
Date (Table 1) ■ 



GROUP 1 N = 15 



QUESTIONNAIRE SA 



Directions 



This questionnaire Is designed to determine some prevalent attitudes about the 
use of computers la instruction. All responses will be anonymous. Each item 
Is followed by a seven step scale from one extreme to the other. Please 
Indicate your response to the Item by placing an X at one of the spaces on the 
scale that corresponds most closely to your leellag. 



.6 1.16 

No Respo 

.1 1.71 
.4 1.59 



1. For purposes of teaching the computer Is 



nse Highly useful / 4/1/6/3/ / / / Useless , 

2. I know \vays of using the computer In the classroom. 

Many / 2/1 / 1/4/5 / l /l / Hardly any 

about using the computer as an instructional tool 



.6 .74 



.2 1.61 



.5 1.64 



.1 1.33 



1.71 



3. I feel 

in the classroom. 

Very confident / !/ /.■^/ 4/4/1/9 / Quite unsure 

4. I am _to use the computer in my teaching. 

Eager / R / R / ? / / / / / Unwilling 

5. How would you characterize your competence in making use of a 
computer as an Instructional tool? 

Considem^i* / /3/2/3/5/ 111 Negllgable 

6. I know of ^ways that I can use the computer in my teaching. 

Isumerous /I /I I 9. / 9 /R /?, / 1 / Few 

7. I plan to use the computer in my work. 

Ofcen / 2/ 3/ 5/2/3/ / / Seldom 

S. How would you describe your ability to choose useful and appropriate 
coi- puter applications for your class? 

Ver^' good / 1 / 2 ' ? / 2 / 4 / 2 / 1 / Very poor 



93 



84 



ID 

(Last 4 digits of your Social Security No, 

Date (Table 3^ 



Group 1 N = 11 



Directions 



QUESTIONNAIRE SB 



This questionnaire Is designed to determine some prevalent attitudes about the 
use of computers In Instruction. All responses will be anonymous. Each item 
Is followed by a seven step scale from one extreme to the other. Please 
Indicate your response to the Item by placing an X at one of the spaces on the 
scale that corresponds most closely to ''our feeling. 



.98 



.93 



1.17 



1. For purposes of teaching the compi^ or Is 



.52 



.93 



1.01 



1.13 



.67 



Highly useful / 3/ 4/ 3/1/ / / / Useless 

2. I know ^ways of using the computer In the classroom. 

Many /1/5/3/2/ / / / Hardly any 



about using the computer as an instructional tool 



3. I feel 

in the classroom. 

Very confident / /5/5/ / 71/ / Quite unsure 

4. I am ^to use the computer in my teaching. 

Eager / 5/ 6/ / / / / / Unwilling 

5. How would you characterize your competence in making use of a 
computer as an instructional tool? 

Considerable / /6/2/2/1/ / / Negllgable 

6. I know of ^ways that I can use the computer in my teaching. 

Numerous / 76/ 3/1/1/ / / Few 

7. I plan to use the computer in my work. 

Often / 2 / 3 - /- 5-/ / 1 / / / Seldom 

S. How would you describe your ability to choose useful and appropriate 
computer applications for your class? 



Very good / /5/5/1/ / / / Very 



poor 



ERIC 



85 



".9 770 



.9 .33 



.69 



.67 



Group 1 N a 11 

9. The r.'.a:e rials that were the subject of this workshop were 

to me as a teacher. 

I;;i.-:iy relevan: / / « / 9 / / / / / Completely Irrelevant 

in. The lrJorrr.'^:lor. :hat these materials presented will be generally 

In my job, 

Ver}- useful / / T / / 1 / / / / Useless 

11. I learned _from this workshop. 

A great Jaal/ 6 / 4 / 1 / / / / /Very little 



12. There was 



.45 



13. 



,70 



14. 



1.481 



.69 



,67 



1r> 
o. 



1.21 



15, 



time allowed for learning the 



laforraatloa presented la this workshop. 

Too much/ / / / 8 / 2 / 1. / / Too little 



The materials used In this worshc'- "ere . . — 

examples of educatloaal materlr'' 

Excellent / 1 / 9 / 1 / / .,,/_ / Poor 

The Iniomatlon aad skills that I learned in this workshop will be 
t o i in the classroom. 

Ver^- valuable / 3 / 6 / 2 / / / / / Worthless 



15. There are 



that I can immediately use what I 



have learned In this v/orkshop. 

-yiz-iy ways / 5 / 4 / 1 / / / 1 / /No ways 
These materials will be a __future reference. 

Valuable/ 6/4/1/ / / / / V/orthless 



17. I would be 



to recommend this workshop to 



rr.y fellow teachers. 

Ver/ aager / r/5/1/ / / / / Extremely reluctant 
The oveTall difficul- level of this v/orkshop was 

V2r-.- dirficult/ ' / 2/6 / I /I /l / Ver:>- ^^sv 



.9 .54 



ERIC 



id. :vlv overall satisfaction with the workshop and materials can be 
characterized as • 



V £•:-.• great/ 2 / 8 1 / 



/ / Verj- little 



95 



S6 



Group 1 N = 11 



20. Check the box which corresponds to your level of experience with 
the computer. 



2 no experience 

some experience (have used computers before) 
moderate experience (have written simple programs) 



experienced (know a programming language and are capable 
of writing classroom applications) 

21. Circle the grade (s) of your primary teachLng responslblHty(ies): 

1 1 7 7 7 6 
K 1 2 3 4 5 6 7 8 9 10 11 12 12+ 

22. What is/are your subject matter specLalty(les): 

a . Math (7) 

b. Science/Math (2) 



c. Business (1) 



d. Library (1) 



23. What Is your level of education 

|T) B.A., B.S. 
[T| B.A.4-, B.S. 4- 
[T] M.A. , M.S. 

[T] M.A. -r, M.S.-r 

[""] Ph.D. 

24. How many years of teaching experience do you have? X = 15.5 Range ; 7-24 



96 



(Last 4 digits of your Social Security N* 
Date fTahlP 9\ • 



GROUP 2 N = 12 



Directions 



S 

.8 .87 
.8 1.3 

.6 1.00 



.4 .90 



.8 .97 



.9 1.68 



.-4r- -.67 



1.08 



QUESTIONNAIRE SA 



This questionnaire is designed to determine some prevalent attitudes about the 
use of computers Ln instruction. All responses will be anonymous. Each item 
is followed by a seven step scale from one extreme to the other. Please 
indicate your response to the item by placing an X at one of the spaces on the 
scale that corresponds most closely to your feeling. 



1. For purposes of teaching the computer is 



Highly useful / 6 / 3 / 3 / / / / / Useless 

I know \vays of using the computer in the classroom. 

Many / 2/3/3/3/1/ / / Hardly any 

about using the computer as an instructional tool 



I feel 

in the classroom. 

Very confident / 2/ 3/ 5/ 2/ / / / Quite' unsure 

I am ^to use the computer in my teaching. 

Eager / 9/ 2/ /I/ / / / Unwilling 

Kow would you characterize your competence in mak"ing use of a 
computer as an instructional tool? 

Considerable /1/4/4/3/ / / / Negllgable 
I know of \vays that I caji use the computer In my teaching. 

Numerous / 2/4/3/1/ / 2 / / Few 
I plan to use the computer in my work. 

Often / 8 / 3 / 1 / / / / / Seldom 

How would you describe your ability to choose useful and appropriate 
computer applications for your class? 

Ven' good / 1 / 3 / 5 / 2 / 1 / / / Verj'. poor 



88 



ID ' ■ - • ■ ■ ■ ' ■■■ ' ::■ ^ 't\ 
(Last 4 digits of your Social Security No. ) 

Date (Table 4^ 



Group 2 N = 12 



Directions 



QUESTIONNAIRE SB 



This questionnaire Is designed to determine some prevalent attitudes about the 
use of computers In Instruction. All responses will be anonymous. Each Item 
Is followed by a sevien step scale from one extreme to the other. Please 
Indicate your response to the Item by placing an X at one of the spaces on the 
scale that corresponds most closely to your feeling. 



.49 



1.041 



.89 



1. For purposes of teaching the computer Is 



.78 



1.16 



1.38 



1.48 



.80 



Highly useful 78/4/ / / / / / Useless 
I loiow ^ways of using the computer in the classroom. 



Many / 5/3/ 3/1/ / / / Hardly any 



about using the computer as an Instructional tool 



I feel 

In the classroom. 

Very confident / 2/ 5/ 4/1/ / / / Quite unsure 

I am to use the computer In my teaching. 

Eager / 6/4/2/ / / / / Unwilling 

How would you characterize your competence in making use of a 
computer as an Instructional tool? 

Considerable / 3/ 4/ 2/ 3/ / ./ / NeglLgable 

I know of \vays that I can use the computer In my teaching. 

Numerous / 6 / 2 / 2 / 1 / 1 / / / Few 



7. I plan to use the computer 



in my work. 



Often / 8 / 2 / 1 / / / 1 / / Seldom 

How would you describe your ability to choose useful and appropriate 
computer applications for your clas^*^ 



Very go,od /1/5/5/1/ 



* / / Very poor 



erJc 



98 



89 



1.03! 



1.53i 



1.08; 



1.15 



Group 2 N - 12 ■ 
9. The materials that were the subject of this workshop were 
• to me as ci teacher. 

Highly rel'svar.t / 4/ 3/ 4/1/ / / / Cor:\?le:ely Irrelevar.! 

10. The irJorrr.ation that these materials presented will hs j,ererally 
In my job. 

Ver>' useful 75/4/' l/l/ /l/ / Useless 

11. I learned _from this workshop. 

A great dea l/ 5/2/4/1/ / / / Very little 



12. There was 



l.OOi 



1.211 



1.51! 



1.34 1 



16. 



1.50' 



1.30i 



IS, 



.3 1.061 



ERIC 



19. 



time allowed for learning the 



Information presented in this workshop. 

Too muc h/ / /l/6 / 2/2/1/ Too little 



13. The materials used in this worshop were_ 
examples of educational materials. 



Excellent / 1/6/4/ / I / I / Poor 

14. The information and skills that I learned in this workshop will be 
^to me in the classroom. 

Very valuable / e, / 9. / 9. / / / / /Worthless 



15, There are 



that I can immediately use what I 



have learned in this workshop. 

^lany wavs / 4/3/2/1/2/ / /No ways 
These materials will be a future reference. 

Valuable/ 7/3/ /l/l/ / / Worthless 



17. I would be 



to recommend this workshop to 



m.y feUow teachers. 

Versv eager / 4/4/2/1/ / 1 / /Extremely reluctant 

The overall difficulc}' level of this workshop was_ 



Yen- difficult / / 1 / / 5 / 3 / 2 / 1 / "^'e^^-' ^-^3" 

I\Iy overall satisfaction with the workshop and materials can be 
characterized as ' • 

Very great / 3/5 / 2 / 2 / / / / Ver>- little 



90 



Group 2 N « 12 



20. Check the box which corresponds to your level of experience with 
the computer ♦ 

[ j no experience 

j~J some experience (have used computers before) 

moderate experience (have written simple programs) 



experienced (know a programming language and are capable 
of writing classroom applications) 

21. Circle the grade (s) of your primary teaching responslblllly(les): 

1 1 4 6 6 9 
K U 2 3 4 5 6 7 8 9 10 11 12 12+ 

22. What Is/are your subject matter speclalty(les): 

a . Math (2) 

b. Language Arts (1) 



Business (2) 



Science (3) 



Math/Science (4) 
23. What is your level of education 



5 J B . A. f B. S. 
[T] B.A. + , B.S.+ 
M.A. , M.S. 
2l M.A. +, M.S.+ 



[~] Ph.D. 

4 None of the above 
24. How many years of teaching experience do you have? 

None = 8 

Score = 4 w/ x = 5 and range: 4-7 



